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Any questions regarding the Patent Term Extension or Adjustment determination should be directed to the Office of 
Patent Legal Administration at (571)-272-7702. Questions relating to issue and publication fee payments should be 
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Application No. 
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Applicant(s) 
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Examiner 
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Art Unit 
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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 
All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1 308. 

1 . This communication is responsive to Response filed on 10/20/2008 . 

2. ^ The allowed claim(s) is/are 1 and 5-11 (Renumbered as 1-8) . 

3. ^ Acknowledgment is madeof a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a) S All b) □ Some* c) □ None of the: 

1 . M Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1 ) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1.84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

6. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attachment(s) 

1 . □ Notice of References Cited (PTO-892) 

2. □ Notice of Draftperson's Patent Drawing Review (PTO-948) 

3. □ Information Disclosure Statements (PTO/SB/08), 

Paper No./Mail Date 

4. □ Examiner's Comment Regarding Requirement for Deposit 

of Biological Material 



5. □ Notice of Informal Patent Application 

6. □ Interview Summary (PTO-413), 

Paper No./Mail Date . 

7. M Examiner's Amendment/Comment 

8. 13 Examiner's Statement of Reasons for Allowance 
9. □ Other . 
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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including tine fee set 
forth in 37 CFR 1 .17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on October 
20, 2008 has been entered. 

Response to Amendment 

2. The Examiner acknowledges the amended claims filed on October 20, 2008. 
Claims 1, 5, 9, 10, and 11 have been amended. Claims 2-4, and 12 have been 
cancelled. 

EXAMINER'S AMENDMENT 

3. An examiner's amendment to the record appears below. Should the changes 
and/or additions be unacceptable to applicant, an amendment may be filed as provided 
by 37 CFR 1 .312. To ensure consideration of such an amendment, it MUST be 
submitted no later than the payment of the issue fee. 

Authorization for this examiner's amendment was given in a telephone interview 
with Peter B. Martine (Reg. No. 32,043) on December 16, 2008. 
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The application lias been amended as follows: 

Claim 1 (Currently amended): An image processing device for processing 
image data using image data and image generation record information that is 
associated with the image data and that includes at least information relating to 
shooting conditions at the time of generation of the image data, the image processing 
device comprising: 

an image quality adjuster that, if the image generation record information 
contains light source information relating to color shift of a light source at the time of 
generation of the image data, is able to execute white balance adjustment process of 
the image data based on color of the light source obtained using the light source 
information, the image quality adjuster adjusting magnitude of the white balance 
adjustment process based on hue of the light source, 

wherein the white balance adjustment process includes: 

(i) a process of analyzing pixel values of a paf gart of pixels making up the image 
data to determine an amount of color cast indicating deviation of hue of the image data 
from gray; 

(ii) a process of determining an amount of the white balance adjustment process 
based on the amount of color cast; and 

(iii) a process of executing the white balance adjustment process in accordance 
with the determined amount; 
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wherein the magnitude of the white balance adjustment process is adjusted by 
adjusting, based on the hue of the light source, a pre-selected processing parameter 
used in at least one of the processes (i) and (ii), and 

wherein the image quality adjuster establishes a condition for selecting pixels for 
the analysis from among all pixels making up the image data, the condition including 
that saturation of a pixel is equal to or less than a saturation threshold value, the 
saturation threshold value being large in a case where hue of the pixel is within a partial 
range of hue compared to a case where the hue of the pixel is outside the partial range 
of hue, the partial range of hue including the hue of the light source obtained using the 
light source information. 

Claim 5 (Currently amended): An image processing device for processing 

image data using image data and image generation record information that is 
associated with the image data and that includes at least information relating to 
shooting conditions at the time of generation of the image data, the image processing 
device comprising: 

an image quality adjuster that, if the image generation record information 
contains light source information relating to color shift of a light source at the time of 
generation of the image data, is able to execute white balance adjustment process of 
the image data based on color of the light source obtained using the light source 
information, the image quality adjuster adjusting magnitude of the white balance 
adjustment process based on hue of the light source. 
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wherein the white balance adjustment process includes: 

(1) a process of analyzing pixel values of a paf gart of pixels making up the image 
data to determine an amount of color cast indicating deviation of hue of the image data 
from gray; 

(ii) a process of determining an amount of the white balance adjustment process 
based on the amount of color cast; and 

(ill) a process of executing the white balance adjustment process in accordance 
with the determined amount; 

wherein the magnitude of the white balance adjustment process is adjusted by 
adjusting, based on the hue of the light source, a pre-selected processing parameter 
used in at least one of the processes (i) and (ii), and 

wherein the image quality adjuster subjects a process parameter representing a 
proportion of an amount of the white balance adjustment process to an amount of the 
color cast, to cause adjustment in such a way that the process parameter is large in a 
case where a shifted hue in the image data is within a partial range of hue compared to 
a case where the shifted hue in the image data is outside the partial range of hue, in 
order to adjust the magnitude of the white balance adjustment process, the partial range 
of hue including the hue of the light source obtained using the light source information. 

Claim 9 (Currently Amended): An output device for outputting an image using 
image data and image generation record information that is associated with the image 
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data and that includes at least information relating to shooting conditions at the time of 
generation of the image data, the output device comprising: 

an image quality adjuster that, if the image generation record information 
contains light source information relating to color shift of a light source at the time of 
generation of the image data, is able to execute white balance adjustment process of 
the image data based on color of the light source obtained using the light source 
information, the image quality adjuster adjusting magnitude of the white balance 
adjustment process based on hue of the light source; and 

an image output unit for outputting an image according to the image quality- 
adjusted image data, 

wherein the white balance adjustment process includes: 

(i) a process of analyzing pixel values of a paf gart of pixels making up the image 
data to determine an amount of color cast indicating deviation of hue of the image data 
from gray; 

(ii) a process of determining an amount of the white balance adjustment process 
based on the amount of color cast; and 

(iii) a process of executing the white balance adjustment process in accordance 
with the determined amount; 

wherein the magnitude of the white balance adjustment process is adjusted by 
adjusting, based on the hue of the light source, a pre-selected processing parameter 
used in at least one of the processes (i) and (ii), and 
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wherein the image quality adjuster establishes a condition for selecting pixels for 
the analysis from among all pixels making up the image data, the condition including 
that saturation of a pixel is equal to or less than a saturation threshold value, the 
saturation threshold value being large in a case where hue of the pixel is within a partial 
range of hue compared to a case where the hue of the pixel is outside the partial range 
of hue, the partial range of hue including the hue of the light source obtained using the 
light source information. 

Claim 10 (Currently Amended): An image processing method for processing 
image data using image data and image generation record information that is 
associated with the image data and that includes at least information relating to 
shooting conditions at the time of generation of the image data, the method comprising 
the step of: 

if the image generation record information contains light source information 
relating to color shift of a light source at the time of generation of the image data, 
executing white balance adjustment process of the image data based on color of the 
light source obtained using the light source information, the executing including 
adjusting magnitude of the white balance adjustment process based on hue of the light 
source, 

wherein the white balance adjustment process includes: 
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(i) a process of analyzing pixel values of a paf eart of pixels making up the image 
data to determine an amount of color cast indicating deviation of hue of the image data 
from gray; 

(ii) a process of determining an amount of the white balance adjustment process 
based on the amount of color cast; and 

(ill) a process of executing the white balance adjustment process in accordance 
with the determined amount; 

wherein the magnitude of the white balance adjustment process is adjusted by 
adjusting, based on the hue of the light source, a pre-selected processing parameter 
used in at least one of the processes (i) and (ii), and 

wherein the executing establishes a condition for selecting pixels for the analysis 
from among all pixels making up the image data, the condition including that saturation 
of a pixel is equal to or less than a saturation threshold value, the saturation threshold 
value being large in a case where hue of the pixel is within a partial range of hue 
compared to a case where the hue of the pixel is outside the partial range of hue, the 
partial range of hue including the hue of the light source obtained using the light source 
information. 

Claim 11 (Currently Amended): A computer program stored on a computer 
readable medium for causing a computer to execute processing of image data using 
image data and image generation record information that is associated with the image 
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data and that includes at least information relating to shooting conditions at the time of 
generation of the image data, 

the computer program causing a computer to execute a function that, if the 
image generation record information contains light source information relating to color 
shift of a light source at the time of generation of the image data, is able to execute 
white balance adjustment process of the image data based on color of the light source 
obtained using the light source information, the function causing the computer to adjust 
magnitude of the white balance adjustment process based on hue of the light source, 

wherein the white balance adjustment process includes: 

(i) a process of analyzing pixel values of a paf eart of pixels making up the image 
data to determine an amount of color cast indicating deviation of hue of the image data 
from gray; 

(ii) a process of determining an amount of the white balance adjustment process 
based on the amount of color cast; and 

(ill) a process of executing the white balance adjustment process in accordance 
with the determined amount; 

wherein the magnitude of the white balance adjustment process is adjusted by 
adjusting, based on the hue of the light source, a pre-selected processing parameter 
used in at least one of the processes (i) and (ii), and 

wherein the function causes the computer to establish a condition for selecting 
pixels for the analysis from among all pixels making up the image data, the condition 
including that saturation of a pixel is equal to or less than a saturation threshold value. 
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the saturation tliresliold value being large in a case where hue of the pixel is within a 
partial range of hue compared to a case where the hue of the pixel is outside the partial 
range of hue, the partial range of hue including the hue of the light source obtained 
using the light source information. 

Allowable Subject Matter 

4. Claims 1 and 5-11 (Renumbered as 1-8) are allowed. 

5. The following is an examiner's statement of reasons for allowance: 
Regarding claim 1 , the main reason for indication of allowable subject matter is 

because the prior art fails to teach or reasonably suggest, including all the element of 
the present claim, that the function causes the computer to establish a condition for 
selecting pixels for the analysis from among all pixels making up the image data, the 
condition including that saturation of a pixel is equal to or less than a saturation 
threshold value, the saturation threshold value being large in a case where hue of the 
pixel is within a partial range of hue compared to a case where the hue of the pixel is 
outside the partial range of hue, the partial range of hue including the hue of the light 
source obtained using the light source information. 

Regarding claim 5 (Renumbered as 3), the main reason for indication of 
allowable subject matter is because the prior art fails to teach or reasonably suggest, 
including all the element of the present claim, that the image quality adjuster subjects a 
process parameter representing a proportion of an amount of the white balance 
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adjustment process to an amount of the color cast, to cause adjustment in sucli a way 
that the process parameter is large in a case where a shifted hue in the image data is 
within a partial range of hue compared to a case where the shifted hue in the image 
data is outside the partial range of hue, in order to adjust the magnitude of the white 
balance adjustment process, the partial range of hue including the hue of the light 
source obtained using the light source information. 

Regarding claim 9 (Renumbered as 6), the main reason for indication of 

allowable subject matter is because the prior art fails to teach or reasonably suggest, 
including all the element of the present claim, that the image quality adjuster establishes 
a condition for selecting pixels for the analysis from among all pixels making up the 
image data, the condition including that saturation of a pixel is equal to or less than a 
saturation threshold value, the saturation threshold value being large in a case where 
hue of the pixel is within a partial range of hue compared to a case where the hue of the 
pixel is outside the partial range of hue, the partial range of hue including the hue of the 
light source obtained using the light source information. 

Regarding claim 10 (Renumbered as 7), the main reason for indication of 
allowable subject matter is because the prior art fails to teach or reasonably suggest, 
including all the element of the present claim, that the executing establishes a condition 
for selecting pixels for the analysis from among all pixels making up the image data, the 
condition including that saturation of a pixel is equal to or less than a saturation 
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threshold value, the saturation threshold value being large in a case where hue of the 
pixel is within a partial range of hue compared to a case where the hue of the pixel is 
outside the partial range of hue, the partial range of hue including the hue of the light 
source obtained using the light source information. 

Regarding claim 11 (Renumbered as 8), the main reason for indication of 
allowable subject matter is because the prior art fails to teach or reasonably suggest, 
including all the element of the present claim, that the function causes the computer to 
establish a condition for selecting pixels for the analysis from among all pixels making 
up the image data, the condition including that saturation of a pixel is equal to or less 
than a saturation threshold value, the saturation threshold value being large in a case 
where hue of the pixel is within a partial range of hue compared to a case where the 
hue of the pixel is outside the partial range of hue, the partial range of hue including the 
hue of the light source obtained using the light source information. 

6. Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 
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Contact 

Any inquiry concerning this communication or earlier communications from tine 
examiner should be directed to Nelson D. Hernandez Hernandez whose telephone 
number is (571 )272-731 1 . The examiner can normally be reached on 9:00 A.M. to 5:30 
P.M. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Lin Ye can be reached on (571) 272-7372. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

Nelson D. Hernandez Hernandez 

Examiner 

Art Unit 2622 
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